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Specification 



1. Title of Invention 

PREDICTED LOCUS DISPLAY APPARATUS FOR VEHICLES 

2. Claims 

(1) A predicted locus display apparatus for vehicles, in which 
an image in a field of rear vision, or a field of lateral and 
rear vision and a predicted locus are displayed on a screen 
at the time of reverse travel of a vehicle, characterized by 
a cameral for photographing a field of rear vision, or a field 
of lateral and rear vision, a steering sensor for detecting 
a steering angle of a handwheel, an image processing device 
for storing a predicted locus corresponding to a steering angle 
of a handwheel at the time of reverse travel and reading an 
image of a predicted locus on the basis of a signal from the 
steering sensor at the time of reverse travel of a vehicle, 
and a display device for superposing and displaying a projected 
image by the camera and an image of a predicted locus by the 
image processing device. 

(2) The predicted locus display apparatus for vehicles, 
according to claim 1, wherein a profile line of a vehicle is 
added to an image of a predicted locus, 
3. Detailed Description of the Invention 
(Industrially Applicable Field) 

The present invention relates to a display apparatus for 
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displaying, as a projected image by a video camera, a field 
of rear vision, or a field of lateral and rear vision at the 
time of reverse travel of a vehicle, which constitutes a blind 
spot, andmoreparticular, to a predicted locus display apparatus 
for vehicles, in which a predicted locus of a vehicle is 
superposed on a projected image of a field of vision. 
(Prior Art) 

Since a driver can directly grasp surrounding 
circumstances along a predicted locus in a field of vision, 
confirmation of safety can be adequately performed in a front 
when a vehicle is driven. However, a rear area and a lateral 
and rear area at the time of reverse travel are in many cases 
not in a field of vision of a driver . Therefore, it is necessary 
to compensate for the field of vision with the use of a fender 
mirror and a rearview mirror. 

In particular, there are many dead spots in a field of 
rear vision, or a field of lateral and rear vision for a driver 
on a vehicle, and specifically, the larger the vehicles are 
such as trucks, buses, or the like, the more difficult it is 
for dead spots become to decrease only with a mirror. Hereupon, 
the use of a TV camera is conceivable in order to perceive a 
field of rear vision, and there is a recent example, in which 
a camera for ensuring a field of rear vision is installed in 
large-sized vehicles, such as buses or the like, so as to easily 
afford confirmation of safety at the time of reverse travel. 
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(Problems to be Solved by the Invention) 

Since a field of vision from a position of a camera is 
different from a field of rear vision as seen from a driver's 
seat, however, there. is involved a problem that the relationship 
between an. operation of driving and a behavior of driving is 
hard to grasp from a screen. Further, due to limitedness on 
an angle of view of a camera, an operation of driving while 
seeing a screen is actually put in a considerably difficult 
situation . 

It, -is an object of the invention to obtain an image of 
a field of rear vision and a field of lateral and rear vision 
with the use of a camera to display the image in a manner to 
sensorily adapt the same to driving, 
(Measure for Solving the Problems) 

Therefore, the invention provides a predicted locus 
display apparatus for vehicles, in which an' image in a field 
of rear vision, or a field of lateral and rear vision and a 
predicted locus are displayed on a screen at the time of reverse 
travel of a vehicle, characterizedby a cameral for photographing 
a field of rear vision, or a field of lateral and rear vision, 
a steering sensor for detecting a steering angle of a handwheel, 
an. image processing device for storing an image of a predicted 
locus corresponding to a steering angle of a handwheel at the 
time of reverse travel and reading an image of a predicted locus 
on the basis of a signal from the steering sensor at the time 



4 



of reverse travel of a vehicle, and a display device for 
superposing and displaying a projected image by the camera and 
an image of a predicted locus by the image processing device . 
(Function and Effect) 

With the predicted locus display apparatus for vehicles, 
according to the invention, that projected image of a field 
of rear vision, or a field of lateral and rear vision, which 
is photographed by a camera at the time of reverse travel, is 
displayed, and when a handwheel is manipulated, a predicted 
locus is read corresponding to a steering angle of the handwheel 
by an image processing device and the predicted locus is 
superposed on a projected image of a field of rear vision, or 
a field of lateral and rear vision. Accordingly, it is possible 
to sensorily confirm a predicted locus on the projected image,. 
Further, when a profile of a vehicle is added to such predicted 
locus, it is possible to sensorily grasp the positional 
relationship relative to an obstacle, thus easily enabling 
operations, such as parking, garaging, or the like, of a 
handwheel. 
(Embodiment) 

An embodiment will be described below with reference to 
the drawings. 

Fig. 1 is a view showing a first embodiment of a predicted 
locus display device of a vehicle according to the invention. 
Fig. 2 is a view showing an example of a mount position of a 
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camera^ 'Fig. 3 -is a view showing a display example of a predicted 
locus, obtained by the predicted locus display device of the 
vehicle according to the invention, and Fig. 4 is a view 
illustrating an example of a predicted locus as calculated. 

In Fig. 1, a video camera 7 is mounted in a position to 5^ 
be able to photograph a field of rear vision (Fig. 2(a)), or ^ 
a field of lateral and rear vision (Fig. 2(b)) of a vehicle. 'J 
When a part (rearmost, most lateral portion) of a concerned 
vehicle is reflected, a distance between an obstacle and the 
vehicle becomes easy to know when the vehicle approaches the 
obstacle. A computer 2. for lo^us calculation stores in an 
internal memory a predicted locus corresponding to a steering 
angle of a handwheel in a reverse travel,, and when reverse travel j3 
is. detected by a reverse travel detection switch 3 (reverse 
gear) , reads- a steering angle of the handwheel from a steering 
sensor 1 to read a predicted locus corresponding to the steering 
angle of the ^handwheel from the internal memory. A locus 
superposition device 6 inputs thereinto an image of a field 
of rear or lateral vision by the video camera 7 on the vehicle, 
andapredicted locus readby the computer 2 for locus calculation 
to superpose and display (suoerimoose) the image and the 

OX 

predicted locus on a display 8 . 

In this manner, since a driver can know a traveling 
direction determined by a steering angle at the time of reverse 
travel on the basis of a predicted locus on an image of a field 
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of rear or lateral vision on the display 8, the driver can 
sensorily perform driving according to displayed contents even 
when the image by the video camera 7 is distorted, and driving 
operations such as parking, garaging, or the like,- and ^ 
confirmation of safety are made easy- In addition, in the 
case where a light is mounted to irradiate a field of view of 
the camera, a night lighting device 5 causes the car reverse 
travel detection switch 3 and a light switch 4 to light the 
light . 

As a predicted locus being superimposed, not only a locus 
of the vehicle but also a profile of the vehicle may be drawn / 
as shown in Fig. 3(a) in order to emphasize a rearmost portion 
of the vehicle reflected in a screen by the camera 7, for example, 
in the case where a mount position of the camera 7 is. disposed 
in a rear portion of the vehicle as shown in Fig- 2 (a) . Further, 
a more sensorily comprehensible display can be made when frames 
aligned at equal intervals are drawn along a locus on the ground 
as shown in Fig, 3(b), or a vehicle body is drawn as a box on 

r 

the basis of a locus of front and rear wheels in a certain position 

as shown in Fig - 3(c) in order to present a perspective feeling . 

y 

Such predicted locus is determined by that turning radius 
of, for example, the rear or front wheels of the vehicle, or 
the vehicle body as shown in Fig. 4, which is calculated by 
a stee'ring angle of the handwheel . More specifically, a formula 
of coordinate transformation into a pro j ected image by the camera 
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from a graphic drawn on the ground is determined by a mount 
position and a direction of the camera. And according to 
coordinate transformation of the predicted locus due to the 
movements of the vehicle from a present position, corresponding 
to respective steering angles, data of loci corresponding to 
respective steering angles are formed as plot points in two 
left and right curves, such data being stored in a ROM of the 
computer 6 for locus calculation. 

In addition, the invention is not limited to the above 
embodiment but susceptible to various modifications. For 
example, while a predicted locus is beforehand calculated in 
the computer for locus calculation to be stored in the above 
embodiment, calculation of a predicted locus may be performed 
by the- computer for locus calculation each time to be 
superimposed . 

Fig. 5 is a view illustrating a processing flow of a program 
used in the case where the computer for locus calculation is 
used to create data for locus display, Fig. 6 is a view 
illustrating a processing flow of a program used in the case 
where a computer for locus calculation is used to calculate 
data for locus display. Fig . 7 is a view illustrating a processing 
flow of an execution program. Fig. 8 is a view illustrating 
calculation of a turning radius and a center thereof. Fig. 9 
is a view illustrating coordinate calculation of a point on 
a turning circumference, and Fig. 10 is .a view illustrating 
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f isheye transformation . 

A program capable cf performing a processing in the 
predicted locus display device of the vehicle according to the 
invention is composed of a locus display data creating program 
shown in Fig- 5 for writing data for representing a locus on 
a screen on the basis of a mount position of the camera and 
a turning radius corresponding to reading of the steering sensor 
of the vehicle, in a file, and an execution program shown in 
Fig. 6 for reading the data and displaying a locus on a screen. 
Also, the other programs include a program for creation of data 
to display frames, which give a perspective feeling to a driver, 
on a locus, a program for conversion of locus coordinates in 
accordance with distortion on a screen in the case where a 
superwide-angle camera is used, a program for interpolation 
of data points in the case where locus data points are distant 
from one another on a screen, and so on. When the system shown 
in Fig. 1 is configured such that predicted locus data are 
beforehand found to be stored in ROM, during driving a steering 
angle is detected, and the predicted locus data are read from 
ROM corresponding to a value of the steering angle, a program 
used during normal driving suffices to comprise at least the 
execution program among the above programs. 

Fig. 5 shows a program used to create 119 data for locus 
display corresponding to information STA of handwheel steering 
angle, and an example of a processing to successively perform 
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calculation of a turning radius and coordinates of a center 
of the radius, calculation of data for displaying a locus of 
rear wheels on a turning center side, and calculation of data 
for displaying a locus of rear wheels on a turning circumference 
side until the information STA of handwheel steering angle 
reaches 1 to 199 to write results of calculation in a file. 
Thereby, 119 data for locus display are created and recorded. 
A program shown in Fig. 6 is an example, in which a turning 
direction branches into left and right with a middle, 60, of 
STA 1 to 119 as a boundary, and presents a processing to calculate 
coordinates of points on the turning circumference while 
decreasing unit step c by unit step c from a central angle 
or increasing unit step c by unit step c from a central angle 
37C/2 to perform perspective transformation and fisheye 
transformation, A program shown in Fig. 7 reads and displays 
locus data and frame data from data files, and detects changes 
in steering to perform display corresponding to the changes. 

In calculation of a turning radius and a center thereof, 
it is assumed that that point on the ground, which is reflected 
centrally of a screen, is an origin of coordinates as shown 
in Fig. 8, a traveling direction of a vehicle on the ground 
is the y axis, a direction perpendicular to the traveling 
direction is the x axis, L and WL, respectively, indicate 
distances between rear wheels and the x axis and between rear 
wheels and a camera position on y coordinates, WR indicates 
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a distance between a left side surface and a camera position 
on coordinates, and W indicates a vehicle width . Also, a turning 
radius R is unequivocally determined by the steering angle. 
Accordingly, assuming that c indicates a central angle (-71 in 
a state shown) , coordinates (Xcp, yep) of a point on a turning 
circumference inside the rear wheels is represented by 

Xcp = R^cos (c) + R + WR 

yep ^ Rxsin(c) - L 
Hereupon, assuming that N indicates a distance from a camera 

to an origin of coordinates on the ground and 6 indicates an 
angle as shown in Fig. 9, perspective coordinate transformation 
of a point on the ground to a screen results in 

e = tan-^ 

L - WL 

N = + (L - WL)^ 

Accordingly, a point (Xj, ys) on a screen results in 

d X x^« 
X3 — _ 
N + y^ X cos 8 

d X sin 6 X y_ 

Ys = '• ^ 

N + y^ X cos 6 

Here, d indicates a distance between a camera and a screen to 
constitute a transformation parameter for correspondence to 
coordinates on a screen. 

Also, when a superwide-angle lens is used for a camera, 
an image will be distorted, so that correction on a screen is 
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needed. Since spherical coordinate transformation in this case 
are 

t hd = tan"^ ^ 

f isheye transformation from coordinates on a screen by a standard 
lens shown in Fig. 10(a) to a distorted image shown in Fig. 
10 (b) results in 

R<ai = bx (1 " ^**) 

a, b: constants 

X31 = Rdi^cos (t hd) 

ysi Rdi'^sinlt hd) 

As apparent from the above, according to the invention, 
a predicted locus calculated from a present steering state .is 
displayed on an image obtained by a camera, which is installed 
in a manner to be able to monitor a field of rear vision, or 
a field of lateral and rear vision of a vehicle and driving 
can be performed while seeing a predicted locus in a reverse 
travel, so that it is possible to improve operability and safety 
in parking. Further, since a profile of a vehicle can be 
displayed together, confirmation of a position relative to an 
obstacle is facilitated. Also, the use of a camera eliminates 
limitation on a field of vision like a reflecting mirror and 
limitation on a direction of a line of sight of a driver, so 
that itispossibleto obtain a wide field of vision . For example , 
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in the case of a distorted image obtained with the use of a 
fisheye lens or the like, a predicted locus is displayed and 
a present position of a vehicle and a position of the vehicle 
relative to an obstacle can also be displayed so as to be 
understood by a driver, so that driving is made possible even 
while seeing a distorted screen image. 
4 . Brief Description of the Drawings 

Fig. 1 is a view showing a first embodiment of a predicted 
locus display device of a vehicle according to the invention, 
Fig, 2 is a view showing an example of a mount position of a 
camera, Fig. 3 is a view showing a display example of a predicted 
locus obtained by a predicted locus display device of a vehicle 
according to the invention. Fig. 4 is a view illustrating an 
example of a predicted locus as calculated^ Fig, 5 is a view 
illustrating a processing flow of a program used in the case 
where a computer for locus calculation is used to create data 
for locus display, Fig. 6 is a view illustrating a processing 
flow of a program used in the case where a computer for locus 
calculation is used to calculate data for locus display. Fig. 
7 is a view illustrating a processing flow of an execution program. 
Fig. 8 is a view illustrating calculation of a turning radius 
and a center thereof. Fig. 9 is a view illustrating coordinate 
calculation of a point on a turning circumference, and Fig. 
10 is a view illustrating fisheye transformation. 



13 



1: steering sensor, 2: 
3: reverse travel detection 
device, 7: video camera, 8: 



computer for locus calculation, 
switch, 6: locus superposition 
display 
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Fig. 1 

1: STEERING SENSOR 

2: COMPUTER FOR LOCUS CALCULATION 

3: "R" DETECTION SWITCH^ 

4 : LIGHT SWITCH 

5: NIGHT LIGHTING 

6: LOCUS SUPERPOSITION DEVICE 

7: CAMERA 

8: DISPLAY 

Fig. 3 

a: DISPLAY SCREEN 

b: PREDICTED LOCUS 

c: PROFILE OF VEHICLE TAIL 

Fig. 5 

1: CALCULATE RADIUS AND COORDINATES OF TURNING CENTER 

2 : CALCULATE DATA FOR DISPLAYING LOCUS OF REAR WHEELS ON TURNING 

CENTER SIDE 

3: CALCULAE DATA FOR DISPLAYING LOCUS OF REAR WHEELS ON. TURNING 
CIRCUMFERENCE SIDE 

4 : WRITE RESULTS OF CALCULATION IN FILE 
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Fig. 6 

1: CALCULATE COORDINATES OF POINT ON TURNING CIRCUMFERENCE 
2: PERSPECTIVE TRANSFORMATION, FISHEYE TRANSFORMATION 
3: CENTRAL ANGLE 

Fig, 7 

1: READ FILE DATA 
2: READ STEERING INPUT 
3: IS THERE A CHANGE? 
4: DISPLAY LOCUS 

Fig. 8 

1: POINT ON GROUND, REFLECTED CENTRALLY OF CAMERA IMAGE 

2: CAMERA POSITION 
3: TURNING RADIUS 

Fig. 9 

1: CAMERA 

Fig. 10 

1: SCREEN BY STANDARD LENS 
2: DISTORTED IMAGE 
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